00:00
2026-06-11
huggingface.co
machine-learning
Profiling in PyTorch (Part 2): From nn.Linear to a Fused MLP
PyTorch's `nn.Linear` module transposes its weight tensor before performing matrix multiplication and addition, as revealed by profiler traces showing an `aten::t` operation that only modifies tensor …